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[#S*f##<oa&B] 
✓V 9^®te-&/£v'*9.Mj:*ji,vC^ 

£4^ti-*/V9^H&-&/£^*9A 0 10 

«fc 9 H^ISHiteT*-^ Srtta-rs«fi£i: L, 

[l»3fciS4] WGfcL-C-flJ**;*-— 9 f^LT^ 20 
✓V 9-rISffc'&J**jfefc*SV'>T, 

WWWWWftIWi] 

[000 1] 30 

[««©«■*-*»*$»] *3S93ia, BWfco-ttay-- 
10002] 

[0 0 0 3] m^>9^*JV>T»4s 11^*^9^=^ 40 

tfftTZZtiT^Z. rwm-=f-*^9T-»^$Hfc 
HI^«ci:oT^y9-=?ffiI^fi£li, K&flHktttS 

TtlSlt?ifo4. A(W«j»Ctt, l«tO*ttroBR^*tS^ 

[0 0 0 4] 1216 (a) , (b) , (c) 14, fl&fco 
✓V 9-^Hitg-g-^— Fd^r^-fo mm (a) , (b) K 50 



*JV»TJ4s 2 &<0@i& 2 0 1 , 2 0 2*»t>^-— 9 y 

^-fifcLT/V 2 0 3 &#TW5. 

[0 0 0 5] 

[0006] Ell 6 (b) <7VV9-e©&2 03WJ:5 

■C**.**'— ^aNSttc-fftfcifc. Hi 6 (c) lc*tJ: 
p fcy V 9-fSHfc 2 0 3 Sr-a-g-r-5^ 2 0 4 SrfSSt 

u *e^2 0 4 to<omtftm*&&\.t£^w$. ws— . 

Wtt) 2 0 5 SrS^Jte-fe^^— ^Tiii!)5^?g:^ 
itht^fc. ^tofcto, /V9-<?llHfe-£-j5fc*:; 

[0 00 7] tt&tt±XS8&l&Tm&\Z.m.3f^ ^5 — 
M-z^fi, S^>V9-viSife^*feSrffi«i-Sr 
[0 0 0 8] 

[^®S:«*-r5fcfe<75#^J ±IESW<Sr^£-rSfc*!) 
K> »*igl«0^V9-vIii^-&fi£^7 i Al4, ffiils&tL 
T— «Bj4**— 9 3'7 , LTV>S«^®tfeSr'&fi£L-C 
ltfcWV 9-* , lffc*rfft5«-.5'V 9-v©te-g-J5£^9 

£<3t^Tiftie/V 9-=rilHfc&ffr3;i-£»'V 9-^®tfe^ 

[0 0 0 9] lt*Jl2W^y 9^1Stfe-&fi£^7',Att, 
±1EW*JI 1 <7VV 9-^M^'&J5£v'^7 1 A<c*3U>T > ilf 

<t o T ^fcfc f>Hfc t <7>Tfc -5. 
[0 0 10] »*JI3^V9-=5'®^-&fie^7 i AJi > 
±IEI#*Jg 1 9-^Sitfe'&fife^9i»<C*JV>-C, ffl 

[0011] fit#ig4 w& 

U 1 tfcw^y 9-^HiteSrf^J5£i-.5z-?y 9 ^Etfe-g-fiK^ 

^S<3v^StIfSz V 9^®ttt&^-r-5 J: 5 Lfc t 
[0 0 12] 



(3) 



4#R!^9-9 14 0 7 



I o o 1 3 ] in i «s *ftw<Dmm<o-&mz.mzs<; 

214, *%W<Ds<; 7-?WteGl$.i>'*TJ±&$*1&£ilZ> 

p< 7 $ y 7vu =i v f * 

[ooi4] ±i\ H2»c^i-^— yt/w=>f3.- * 
s^^awsv-c, lii^^fa.— 2 
■14?*— ***P-*-S7V*7V<*\ 3 14tt^ 

f^>^V^fifcSv^ ( 4 14-7 P 7. 5 

tei ici4, i/m^v*— 7*— ^6icj:-5tiw^7 

7A*«iWS*vt</->.5. WJ§<<>9— 7^— *6I4, 
|6p-<5 7s-^S C S I y^-7i-X 

5. 20 

[0015] fcK, **t«in/V7?ii*^^ 

[ 0 0 1 6 ] El 1 »-*5V>T, 11S/n-K*s7, 12 
14^— K^^T 1 1 co±-Cltif^-r -5 U— 7 >^ 

*t"a (os) , i 3»*os i 2<r>±.xWiYf-r^>ryv 
ltosi 2-kmi&-fz>zfu y >?<r>b^ m&mn-t U 

5&l21^LTV>ftv>7*ti s/^W^i: LT, >•>— 30 

*r-e«4cpu^*y<SfAs, s-fcos-ete^yn 

[0017] i A\*.y r 4 fl^y 1 — # ■&%vm.&)\z. 
tetitrtZ^— K-Tw**, 1 5 140S 7 r-f 

y'Wv'^xA-efel?, T7'Vtr— *S<a V77 K^iT^n 
— K^ir £S:HHi-f *i 7r-f /K75Atb^3 J: 5 
te-*-3$fctE* 5 &3. 1 6 B7r^A"^fA 1 5 a*^— 

K-T-f^^ 1 4<D^##Sr^f 5 fcfcw-r-f 7 I O-Y 

^*-7*— ^-c-fc-s. i 7i*os^«fifci-s*s® < i : a 

•^fAfS)!), 77"J^-: ^3^7 h^*TSr«ia 40 
[0018] 1 8 ttttMfSv'^xA 1 7 j&StV 77V 
5. 19 140 S SrlsJtSA*^ ^fl^fAf 

77*y^- ->3>y7 h^^rsrsia-e-fi-^-— 

5 e 2 0 ttATJf^W ^flv/^fi 1 9 jJS*— #— K 
5 WA^$rS»t5t5fc*W^— aK— KM V* — 7 *— 
7,, 2 lliATJr^-Y^fli'^fAl 9*s-^f>^3A» 



7^—xX-hZo 
[0 0 19] £(bK, tt^;tM7 7l4, WXfa'Ofi — 
7i-^tt<BSCS I ^^^—7*— 7-2 2Kgi®g 
£n, A/jf/^^fl^fAl 9SriILT, SHStT* 
— f>4$<D->$"9lfr<r)t;ftoZ. b&X%Z B 2 3I4IS&7*— 
^fSv'T.T^-e&o, 2 4I4IS&7— ^S^r-iVi^ 
-^JSttffi flU t> U < tta-T^ A7J lw «fc £ !7 - 

AAte-fcS*— 7— K<9 ffc* L-^^-T 5f-?S*f 

[0020] 7-v!lHfefft5£i'-7.7"A 2 6 14, Enters 
£>;*-— /<— 7 :x7 p teM£#*TIIi&&'£-fi£-*-5AV 

&&j®W<£^T-t&tiB-r*i®&tedti#t3:2 8 £;6>ib& 
S. 

[0021] ttft&Lfcil!), ^-^T.T'Aii, m=f-^^7 

x-tmztitcffl&.<Dm&*&f&vx i tfeo^v 7-^ns^ 

fifc&fi-T-;* ^ 7 7 y => viiMf-? Sr => f — 
[0022] m-?-^^ 7 7 -e»4, Ji^^ixfcllitfet* 

i> 9 ^y7^is^<o®tfe^js^-rsi!Sjci4m^p«7 

[0023] /V 7TlHfeltii^— Kftw«^$Kfc® 
K" ^ lo<D^y7-^ffii*feSr«fi£r57b 

[0 0 24] E3I4, ^^7rt<75Hi^-r r — 

[0 0 2 5] *^77S:W^- 7*— 7.6Sr7>U 
T3>fa-#»ilSaRU Btfef-^H^fA2 3 
Sr^KrTSo W&f—^^m^^^ 314, *^7rt 
W-T— *^7^^n^i:^*1I<0#ttfjHfc7-l'> 
K>7 3 1 tc^^-TSo 3 2 14®^— ^ W3g/h®^ {ft 
A^~/Hl{fc) , 3 3l41i«!OjH41ffii:L-C«^BNf 
«SE*5^**U«, 3 414a*— yt^avf a— 9<n/^— 

— 7"*^:? a ^tgSA/•C^^•5. 

[0 0 2 6] a— T-'^^^^^o^S It d>t>Sifc!& 
S^LT (3 5»4®tR$*V7br b*Wfrti>W) , 
if*^n^3 4tiT^7,3T i D r a g&D r o p <T>Wfe 

(7J^7rt^x— ^14^5) , 1&Wt<nfr (*pt7rto 
7-^i4tB*$ns) »4, a-— ^'<o*§«-ei'*,t ) ic-x?'b 
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[0 0 2 7J ^W=t*-^cO*^^, /V7^ 

[0 0 2 8] 04|:i5V^t,..if, ^X^S 1T% a- 
— -ft 9 n ^ 3 4 l£ Ko y 7* Sftfc* A*— /HC^-T 

t L-C3— - V#?ti {TZ 4 fcSft-TS. 'V 
7-^SHfeTfc5 itli ^TyZfS 3-C*ttflMM»fcl«l 
-<7VV 7-7 I DSr^trgHfex— * 5 
5o ^^S4ttt v '&bfi1t.W!i<omte*J%^X^ 

[0 0 2 9] m5li, «1j|E^XS'7 s S4^V7-^-&J5£ 

[0 0 3 0] *-f, ^fs/ysi l-Cli, -S-fifc-fSUHfe 
ttj-f*,, mcxTyzfs i 2te*5V-t, iHJiE^s'T's 

7"S13 -Ctt, «&<OSite&^£LT ltfctfvV 7^1 

l o o 3 1 ] m e it, MJs.^tttb«kswT/i'=i p y xao 

z r -Clt, 3e t &<nm& 4 1, 4 2<r>2 ^(om^^-r. 
m&0>tm& 2 tfe J; •) # ii 2 tfco-g-jfc&ME] 

[0 0 3 2] ^v-^^ATIt, *<J 7-*Wfob\^Xffi& 
-TZ> t # t LT, */h 1 0 %, «*50 

=r>-f\ — ykWLfe*Z>&m4 313, Jfc9 0%, 

m o%offifflicis;^-r-5. *fc, ^-r^fflit, 

0 0%, *5 0%OffiB4 4 iCKJfcSftS. 

[0033] yr43i>f., 3i s/ 

*0*f^m± (x, y) t <x' , y' ) SrfcttS.S 
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[00 34] JBl-h^toS^tRII h ti. 5 :4s rft&ig 6 W 
[0 0 3 5] *i\ ^fy7"S 2 1 T^s> S^fctiiIlH&& 
7^ V- K^|S^i-5g5ffl4 3A^, syi?^fi 

io ^>h»ffis*^, *®^4 a*©-*— ^mm4 6& 

f££i-3 Ufy7'S 2 4). 
[0 0 3 6] -tUT, H— ?1£H<fWBigt4 6 T> 

&<omttU* t <0 ^w-^W-Sr*** (^t 1 y7"S2 

Sr^^s/^L. (^t's'T'S 2 6) -tjt&Jlti^y 
7"S27T?, *Ot- ^SSH^ WaKl'^hW^t-tW 

20 -f. 

[0 0 3 7] y7 , S2 8tt-fffii±t 

•lr J ?'o^S:5 i 3is'^ U ^7y7'S2 9t < 

^•9taufc^-<>hoM« (x. y ) S/Wias* 

«>ibnfc>K-Y>hO^ (x' , y* ) *rtf>*/Jv|it 

[0038] &.±.*<r>zfu- ywrfesm-zmztt^x 

30 (^7y7"S3 1) , ^TLfct>^JC:.«wy^ 

/MStLT^m-S (X7- >ys 3 2) . 1JI±T'»J*:.^ 
[00 3 9] ftlC ttFlE^x 3/ /S 1 1 «>^^KttttM& 

[004 0] Mte£2tSciL7ti:tK (2feW±«73-&fi£ 
co^t. 2tfcO-^J5£(0«l!5 5gL^<OT% *i x lt2t!ci: 

#^tj:^) , ^w-fH»t> x, y^rsj^aei, mms. 

(x, y) , (x' , y' ) lt^T^J:plc«ii:5. 
[004 1] 
[»1] 



50 
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[y'j " {l-sine cosejW ~UJj 

(jn(oos6 'X + sin6 -y - Ax) \ 
m(-sin8 -x + cos9 -,y - Ayy 

-Bx+Ay + D) 



^-To «toT> ;<7*—*A, B, C, D-Sr*»5:i: 
K «fc »> rw«^«:gt: i: 5 0 5te<o#jS.6#j 

it!MSTti\ #£.6 (x, y) v (x* , y* ) 0«?gSt 

A, B, C, DSr**t>5. 
[0 0 4 2] 
1&2] 

- ^{{Ax + By + c)- x'} J + {(-fix + Ay + D) - /}*]— min 



[0 0 4 3] 



* 1&3] 



as/M - (x* 8 + 2y i ) A + (2 *) c + (2 y)° + l-X-^S*') - 0 
bb/bb - (2* a <- 2>> +(2 *K - (2*)° + (-2^ + 2^*) - 0 

Bb/BC - fa)* + (J 7>B +»c - (s*') - o 
ae/au - (2 ^ - (2 x)b + «£» - (£y) - 0 



^A. B, C, D&jfcfc*. r-T> 

[0 0 4 4] 

ft-2 x +2* 
ft "2* 
ft -2* 
a-2« , *2w' 
ft-2^-2*'* 
ft -2*' 
ft -2y 

tt5t> s**?*—* A, B, C, Dli&W«t9l^-T 

[0 0 4 5] 
[&5] 



^ m PtP»+P>P 7 -P4P, 



30 



Pl+Pi -PiPt 



J Pl/»6 -PlPl ± Ps.Pt. 
Pi +Pl ~PiPt 

Q Pt~ Pl A ~ Pl B 
ft 

D _£7_lftfi±ft£ 

p. 



b\C£9s ;<7*-9A, B, C, D^ttJ-T5 0 
[0 0 4 6] ^fy^S 1 3 W@Hfc-£fiSycS»CO 

V^WM"*"*. B, C, D«**P>lxfc 

«0Tv 
40 [0 04 7] 
1&6] 



tx\ f Ax + By+C\ 
(yj \-Bx+Ay + D) 



LT<5 (5 1' ) . &K> ^l£ilHfeO^»)eo8i# 
50 (x, y) 5 4K.Ol^T, ±.j£frb y attS-fStgiSS 
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(x' . y* ) 5 5&#«>5, -tUT, #HHfe5 2<T> 
(x* . y* ) ff>H*«r (x, y) fc=tf— f3 (5 

5. 

[0 0 4 8] E1914, d— f^-r— 

[0 0 4 9] ^f3//S4 It?, Sirol^ (I8W 

(x, y) fco^T, ±5*;a>i=>, 
<x' , y' ) ^fy/S4 4TI4, 

(x* , y' ) %2^)@% (H8-C«>;&nifc) rtt- 

(x' , y' ) Oli^S: (x. y) l:atf-t5. 

[0 0 5 0] a±t^rtBft«aO«Wti-CfcS#LT 

[0 0 5 1] 14*Lfc^f y/S 5<£>®tfefc&tb 

fcJ:0*6HMMfc#*HfcSii»*. E110 (a) ~ (d) 
14, 2tt0aHfc*£j&LT7t.^V?^V1ka>&*g& 

[ 0 0 5 2 ] /V 9^Bifc«rfh5W-'**i*e>te 2tk»Bifc 

■Hunr-riv*,, *##&i>wv\ hi o 

(a) ~ (d) fcjjfrfvV^HHfctt, 2tfc»lB{fe6. 
1,62 ft'ftA e «v^t, l^iatcaM-J: 5 \z-T1xx-£f& 
SfvfcfcO-efcS. :t3ftll08ttaVHfctttf#&2 8-c 
14, v^oaxOtettt^jfeSrsSllts /V^B&OTcteft 

[0 0 5 3] *-f, P3EI (a) tC3*-ftttBJMfe 1 li, 7K 

^6 3^tttii$tvS. I3EI (b) »C^rfttm^)£2li, 

;:<7?#fei4^6 4riM*thl£H5o IDEI (c) »C 
^rtttt^ffi 3 14, 2 &tf>ilHfeF.fl tf>¥#;£»*ffi^ 
fc$E?K&tttb-f-5'btf>t\ r^T'lie/2ffl^fc5EE^ 

6 5^t4m*ixs. ttdJ*&2S.o%m*i£3<7? 
ttta®tfe6 4, 6 514, -ttvm-e, -&/2tmm 
m$fixm%<r>*i^mfe*r—5>btiLZ>„ mm u) 

ii*ltl^jSfe4l4, 2tfcWHtfeSr*»c-^AyT?^5^Srtt 
mi-5'b<£>T, ^(D^-CI45£?g6 6^-tV^^fc-5o 
[0 0 5 4] 2tSc«^li^«^l?*»Ctt^ 
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fc^toftft-ct^*. Ell il42tt<ai®te<oS&!):fc-ite 
tiiT5&M<n-W*7tt-®Xh'0 , r*il4, ffctia^fei 

(Or— >T— 7/1- k LtMfcltL-CVS. 
Ell 2totwtettV<:?— zf>v<o— 

[0 0 5 5] 121 2(£>*t8 114, HI 1 li:*Lt/V7 
■^lin^- *MB!!rt--5t>0>:?fcS. ;i;h,£El 1 3 £ 

io ^v^TiftM-rso 

[0 056] El 1 3 14, ttta^-?^— ^X— y/KOtttWI2 

<Ot£fi£r3iL-CV3. Ell 3 i t) 2 o<OjE?g<73fifc 9 # 
a^V7-^IlH&7 lcO«fc5t£ft3fc»<73#M$iLT3i# 

9iis*»?>ti,5, temmbi 2<o&m.&(o&m 

149 2<DJ: 5»i*«>e>ix*. t4U3^<^— >T— tVws 0 
fcbtMfe w^fSw^ia as x $4 1 U < 14 y *MC7K¥T?ft V 

[0057] ;ro,k9i: LT*«>fcfiE^T(OS7i •? J? 

[005 8] &c«c_hi6LfctttB^^— >T— zfj^m^ 
xm&t&tiatiii-Ztim&mi 4<nyu—f-^—V%:m^ 

[0 0 5 9] 77y7"S5 1 »ctJt>-C, ±5SLfc 

S5 3-CI4, t 1 — ^K75 "Efi" co^SSrlS^, ^St- 

[0 06 0] W±«t9, ^7i»/«C*)*, 

[0 0 6 1] /V 9-7®tfe*^ttai-r'55©gS:3S 

f?i-5fc*W^lJE?rEIl 5»CSVf„ 
40 [0 0 6 2] Ell 5<01 0 014, El 3 Kiil^T, a-— ? 

— ftfD r a g&D r o p ^Hfc*i^-(C^^$tl-5Mi® 
El 1 5 {C*JV>T, 10 1 14^V 7 ixfc 
10 2 z>S3fc^$*v5'V 9-^l®^*WiiE-Cfo5o 
ti^life-^^T'/'i' 103H106 »4^-«y 1 0 

1 ^^c,ttW*i£4 izttm LT</>5 0 
[0 06 3] a— ^*l4*7p:*ix-C^5ttdl!iiffi!l»->'7 p yl' 
50 i!>>b&M<r>b<n*-*'>X3X'? V yir-Th I: -Zntbtii J? 
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jfe'K»*Ufc®eW«*^ 'V 1 0 2±lwt4tU 

*B£l 0 7<£»«fc 9teffc^£*V5. 3S*R£*l-CV>* 
tttB®^>'7 , /H 0 8 «7>«t o |C#Tffl*nT^$tl 

mm 10 1 t??!tfSi--5 r t 3. wawttttttrife 
ASJlo^o OKjK^I 0 9Sr*i^-T5^i: 

[0 0 6 4] Et_hOlft0!te*5V>-CWu 'Vv-v®<8t&f£ 
ift<, 2^±W®&;J><bfc5'V7^iIi&^fc^ 

ife^&^ftgK^Lfefr&o^-mft < ft t> mm 

[0 0 6 5] 

#<tBffc«r*« i t *s-5T«B t ft S. 
[00 6 6] n&*M.2<Ds<; : 7-?m'fe%fSLi'* 1 rMci: 

^<0ft^£#ftMte£ffi*J^ft?£K^.5 r h tr^tffc 
ift3. 

[006 7] l»*JI3 <Ds<S =7-vm&&&~l<'*'rMz.£. 

^5-tI$oft^&#ft®{fc&iffimj.oft?iK4#. 
•SririS-BTHiftS. 

[00 6 8] ft*JS4 0VV 7^©£t-&j££i£K<fc;h. 

WttfcbifcSKg-^ vctijfE^ V 7-^lijtgSr^fi£i-5 «fc 5 
teLfcw-e. ^5-ffi^ft^&#ft®fc<H§-3::£jiS 
•BTtEift*. 
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[01] *5Ib^o*S£o-^|j:#5^V ^-^ffirtfe-^fife 
[02] *^^V7-v@^fifev'^7 1 A^SS$tv 

IH 3] # ;< 7 ftwUHfe^— *£ = >f a— = f 

[04] # 7 ftWpHfc-^— ^tra^f^— ?^3f 
10 — -T-SISlcfr 5«lSr*t7D- f 1 -^— hffoS. 
[El 5] /V7^«il(07c- ^-t— hTfcSo 
[06] M^fttti«! ! l<?37^^yXA(07D-f-V- 

[117] ttfS.SttUiMS^T^T'u— hUttSt^*^ 

[08] Etfe-g-^MS^^-fE-CfeS. 

[09] I^M?:^7D-f-f- hT-fc^o 

[0io] s<; 7-*mm*i>9mm%L*tiitii-rzj3&* 

20 [01 1] 2tfc<^lli^*/i9*-i:ttaj-r€>^W-'fi»l 
?ri5rr0T-fc-5. 

[012] tt^^-^7-7'/vm-Fjlr/TtlifS) 

[013] awt**— >t— ^wwBiW0-e*)5. 

[014] Iljtfettlll«! ! S^^H-0TfcS. 

[015] ^v9-7iiitfe*^ttm-rsjg^ffi*sr®*?-r 
*^Sr^-r0-efc5. 

[016] |^(©'V?^BHfc*l*©^*:;5*+1H-efc 

30 m^n^m 

2 

3 -v?* 
4 

5 K 

6 iRffl'CV^— 7i- * 

7 m^F* ^ 9 

11 /n— K»*.T 

12 OS 

40 13 ryy-ir— i^a h !7iT 

14 /n— 

15 7r^4'^fA 

16 ^^?IO^^-7i-? 
1 7 JSWffSi'.^T-A 

18 tf^^-O^— 7*— ^ 

1 9 AAf/V^fl^TA 

2 0 Y<<>9— 7*— * 
2 1 T!>M^-7s-^ 

2 2 S*^^-7x-VSCS W^-7* 
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2 3 m&?— fgrnis^TJ* 
2 4 i r—?mm&®. 

2 5 
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2 6 A J 7^1Stef^fi£v'^7 1 A 
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* NOTICES * 

Japan Patent Office is not responsible for any damages caused by the use of this 
translation. 

1 . This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The panorama image composition system characterized by to have a rectangle field 
extract means extract automatically the image data contained to the field which serves as a 
rectangle from the inside of the image after composition of two or more of said images in the 
panorama image composition system which compounds two or more images which the part 
overlaps as a field, and creates the panorama image of one sheet, and a panorama image 
creation means create said panorama image based on the extract result of said rectangle 
field extract means. 

[Claim 2] The field used as said rectangle is a panorama image composition system according 
to claim 1 characterized by what it opts for beforehand with the configuration of the image 
after composition of two or more of said images. 

[Claim 3] Said rectangle field extract means is a panorama image composition system 
according to claim 1 characterized by having considered as the configuration which extracts 
said image data with two or more rectangle patterns, having chosen the thing of arbitration 
from the inside and using the selection result as said panorama image. 

[Claim 4] The panorama image composition approach characterized by to compound two or 
more images which the part overlaps as a field, to perform rectangle field extract processing 
of extracting automatically the image data contained in the panorama image composition 
approach which creates the panorama image of one sheet to the field which serves as a 
rectangle from the inside of the image after composition of two or more of said images, and to 
create said panorama image based on the extract result of the rectangle field extract 
processing. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the panorama image composition system 
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which compounds two or more images which some images overlap, and obtains the image of 

one sheet, and the panorama image composition approach. 

[0002] 

[Description of the Prior Art] More generally than before, the technique called the panorama 
image composition which compounds two or more images which some images overlap from 
demand of photoing a wide image and making it the image of one sheet is known. 
[0003] In the electronic camera, the lowness (little of the number of images) of resolution is 
specified as demerit in comparison with a film-based camera or a scanner. Panorama image 
composition is important for the image photoed with this electronic camera also as a means 
which photographs a high resolution image [ photograph / not only / a wide image ]. A 
manuscript, a magazine, etc. of one sheet of paper are divided into plurality, and are photoed, 
and, specifically, power is demonstrated for it to divide scenery into plurality and be wide, and 
take [ acquire about the same high resolution data as a scanner, and ] a photograph to high 
resolution. 

[0004] Drawing 1 6 (a), (b), and (c) show an example of the conventional panorama image 
composition. In this drawing (a) and (b), the part overlapped from the image 201,202 of two 
sheets was detected, the image was compounded and the panorama image 203 has been 
obtained so that they may lap. 
[0005] 

[Problem(s) to be Solved by the Invention] However, there were the following troubles in the 
above-mentioned panorama image processing. 

[0006] When the image made as a result of compounding two or more images like the 
panorama image 203 of drawing 16 (b) does not have a rectangle, in order to make into a 
rectangle the image which becomes resulting and to make it the data format which can be 
treated by computer, as shown in drawing 1 6 (c), the rectangle 204 which includes the 
panorama image 203 set up, and means, such as filling with a suitable color and a suitable 
pattern the field (dummy area) 205 where the image information in a rectangle 204 does not 
exist, were taken. Therefore, the image made by panorama image composition had turned into 
an image which cannot be said as fitness including a dummy area. 

[0007] This invention aims at offering the panorama image composition system which can 
obtain a good image without a dummy area, and the panorama image composition approach in 
view of the above-mentioned conventional trouble. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, the 
panorama image composition system of claim 1 In the panorama image composition system 
which compounds two or more images which the part overlaps as a field, and creates the 
panorama image of one sheet It has a rectangle field extract means to extract automatically 
the image data contained to the field which serves as a rectangle from the inside of the image 
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after composition of two or more of said images, and a panorama image creation means to 
create said panorama image based on the extract result of said rectangle field extract means. 
[0009] The field where the panorama image composition system of claim 2 serves as said 
rectangle in the panorama image composition system of above-mentioned claim 1 is 
beforehand decided with the configuration of the image after composition of two or more of 
said images. 

[0010] In the panorama image composition system of above-mentioned claim 1, the 
panorama image composition system of claim 3 considers said rectangle field extract means 
as the configuration which extracts said image data with two or more rectangle patterns, 
chooses the thing of arbitration from the inside, and uses the selection result as said 
panorama image. 

[001 1] The panorama image composition approach of claim 4 compounds two or more images 
which the part overlaps as a field, performs rectangle field extract processing of extracting 
automatically the image data contained in the panorama image composition approach which 
creates the panorama image of one sheet to the field which serves as a rectangle from the 
inside of the image after composition of two or more of said images, and creates said 
panorama image based on the extract result of the rectangle field extract processing. 
[0012] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is 
explained with reference to a drawing. 

[0013] The block diagram showing the panorama image composition structure of a system 
which drawing 1 requires for one gestalt of operation of this invention, and drawing 2 are the 
external views showing the configuration of the personal computer system which is the 
platform where the panorama image composition system of this invention is carried out. In 
addition, this operation gestalt shows the case where compound two or more images photoed 
with the electronic camera on a personal computer, and the panorama image of one sheet is 
created. 

[0014] First, as for the display whose 2 1 displays a computer system body and displays data, 
the mouse which is a pointing device with typical 3, and 4, in the personal computer system 
shown in drawing 2 , a mouse button and 5 are keyboards. Furthermore, the electronic 
camera 7 is connected to the computer system body 1 by the general interface 6. A general 
interface 6 is a general interface in which an image transfer at high speeds, such as a 
bidirectional parallel interface and a SCSI interface, is possible. 

[0015] Next, the panorama image composition structure of a system of this operation gestalt 
is explained using drawing 1 . 

[0016] In drawing 1 , the operating system (OS) with which 1 1 operates by hardware and 12 
operates on hardware 11, and 13 are application software which operates on OS12. In 
addition, although naturally contained as requirements for a configuration among the blocks 
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which constitute hardware 11 and OS12, when explaining the operation gestalt of this 
invention, it is not illustrating about the block which is not needed directly. As an example of 
such a block that is not illustrated, there are CPU, memory, etc. by hardware and there is a 
memory management system etc. by OS. 

[001 7] Moreover, it is the hard disk with which 1 4 stores a file and data physically, and the file 
system with which 15 constitutes OS, and there is a function to enable it to output and input 
a file, without application software being conscious of hardware. 1 6 is a disk 10 interface for 
reading and a file system 1 5 to write a hard disk 1 4. 1 7 is a drawing managerial system which 
constitutes OS, and has the function which enables it to draw without being conscious of 
application software. 

[0018] 18 is a video interface for the drawing managerial system 17 to draw on a display 2. 19 
is an input device managerial system which constitutes OS, and has the function to enable it 
to receive a user's input, without being conscious of application software. A keyboard 
interface for the input device managerial system 19 to receive the input of a keyboard 5, as 
for 20 and 21 are mouse interfaces for the input device managerial system 19 to receive the 
input from a mouse 3. 

[0019] Furthermore, it can connect with a bidirectional interface or SCSI interface 22, and an 
electronic camera 7 can let the input device managerial system 19 pass, and can exchange 
image data etc. 23 is an image data management system and 24 is a data control means for 
managing image data by the file name, attribute information or the keyword by a user s input, 
etc. 25 is a data display means to search and display the image data managed by the attribute 
information or the keyword by a user's input. 

[0020] The panorama image creation system 26 consists of a panorama composition means 
27 to compound an image in quest of the overlap location between images, and an image 
extract means 28 to compound and to extract the made image which is the description of this 
invention with a suitable rectangle. 

[0021] This system compounds two or more images photoed with the electronic camera, and 
creates the panorama image of one sheet as mentioned above. In case this system copies 
image data to a personal computer from an electronic camera 7 (transfer), it performs 
panorama image composition. 

[0022] In an electronic camera 7, photography time, photography mode, etc. are recorded as 
attribute information with the photoed image. In case the image for panorama images is 
photoed, the photography mode of an electronic camera 7 is set to "panorama image 
photography mode." 

[0023] The panorama ID with "panorama image photography mode" same [the image 
photoed in panorama image photography mode ] in attribute information again is set to a 
series of images photoed since one panorama image was constituted by photography mode. 
[0024] Drawing 3 is drawing showing the actuation at the time of copying the image data in a 
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camera into a computer. 

[0025] A camera 7 is connected to a computer through a general interface 6, and the image 
data management system 23 is started. The image data management system 23 displays the 
data in a camera on the window 31 in which it was attached to the camera catalog and the 
identifier. As for 32, the contraction image (thumbnail image) of image data is displayed, and, 
as for 33, photography time etc. is displayed as attribute information on an image. 34 shows 
some image databases of the user who exists in the hard disk of a personal computer, and is 
reading this with the user catalog in this system. 

[0026] A copy will be performed, if a user chooses an image from the camera catalogs 31 
(frame which indicates that 35 was chosen) and operates Drag&Drop with a mouse 3 to a 
user catalog 34. At this time, it changes [ (the data in a camera are eliminated), and ] by 
assignment of a user whether it is a copy and whether they are (data remain in a camera), and 
migration to both. 

[0027] In the midst of this copy actuation, if it is the image photoed in panoramic exposure 
mode, panorama image composition processing will be performed. The above processing is 
explained using the flow chart of drawing 4 . 

[0028] In drawing 4 , the attribute information which accompanied first the image data and it 
corresponding to the thumbnail dropped with the user catalog 34 at step S1 is acquired. At 
step S2, it confirms whether to be the image which investigated the photography mode in 
attribute information and was photoed in panoramic exposure mode. When it is not a 
panorama image, it registers with a user catalog 34 as image data usual at step S6. When it is 
a panorama image, the image data containing the same panorama ID is transmitted from a 
camera in attribute information at step S3. In step S4, panorama composition processing 
mentioned later is performed using two or more obtained images. Then, the panorama image 
obtained by image extract processing in step S5 is made into the image data of a suitable 
rectangle, and a final panorama image is obtained. 

[0029] Drawing 5 is the flow chart of panorama composition processing of said step S4. 
[0030] First, at step S1 1, the image to compound is investigated and the overlap location 
between images (corresponding points) is detected. Next, in step S12, the parameter for 
deformation of the image at the time of using for composition from the corresponding points 
detected at said step S1 1 etc. is computed. Based on it, at step S13, two or more images are 
compounded and the panorama image of one sheet is obtained. 
[0031] It is drawing in which drawing 6 shows the flow chart of the algorithm of 
corresponding-points extract processing, and drawing 7 shows the template image and 
matching range of corresponding-points extract processing. In addition, the example of two 
sheets of the images 41 and 42 of the left and the right is shown here. Since what is 
necessary is just to repeat composition of two sheets several times when two number of 
sheets of an image is large, as processing, it is fundamentally the same. 
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[0032] In this system, making an image overlapping a minimum of 10% and a maximum of 50% 
and the gap of a direction which carries out a right angle to it are decided to be 5% or less as 
the Ruhr when taking a photograph as a panorama image, respectively. By this, the range 43 
which sets up a template is set as 90% long and the 10% wide range. Moreover, the range to 
search is the range of possibility that the point of corresponding exists, and is set as 100% 
long and the 50% wide range 44. 

[0033] From the area 43 in an image, an edge looks for a strong point beyond a predetermined 
value, and starts length and a n pixels wide rectangle as a template image as the core there. 
That difference is taken for this template image 45 per pixel on the search range 46. It shifts 
1 pixel of search range tops at a time, and asks for the place where this sum total serves as 
min. If the minimum value of the result of having searched all search range tops is below a 
predetermined value, it will hold the points (x y), and (x\ y') of those as a pair of corresponding 
points. 

[0034] Although the above serves as an outline of processing, this is already explained to a 
detail at once along with the flow chart of drawing 6 . 

[0035] First, an edge extract image is created at step S21 , and an edge looks for the powerful 
point beyond a predetermined value from the range 43 which sets up the template in this 
edge extract image at step S22. If there is the point, an image will be cut down with the 
rectangle of every **n pixels of every direction from the point, it will consider as the template 
image 45 (step S23), and the search range 46 in the right image 42 will be set up from the 
location of the point (step S24). 

[0036] And the absolute value of the difference of a pixel value is taken for the image 46 and 
the template image 45 in the search range per superposition and pixel, and the sum total is 
searched for (step S25). it confirms whether to be the minimum value till then (step S26), and 
if the total value of this difference comes out so and there is, it will hold the coordinate and 
the minimum value of the point in that search range at step S27. The above is repeated in all 
search range and a point (it has the minimum difference) most in agreement is found out. 
[0037] Furthermore, it checks, and the minimum value which is step S29 and was calculated 
as a result is a sufficiently small value, or (are they clear corresponding points?) it judges 
whether all search range was done at step S28 as compared with the predetermined value L. 
When smaller than the predetermined value L, the coordinate (x y) of the point which cut 
down the template image on the list of corresponding points, the coordinate (x\ y'X and the 
value of the minimum value of the point with which the minimum value was calculated are 
registered (step S30). 

[0038] If the above is performed to all template setting ranges (step S31) and it ends, the 
average value will be calculated from all the minimum values under list of corresponding 
points, and this is held as a coincidence level value (step S32). Corresponding-points extract 
processing is ended above. 
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[0039] Next, the synthetic parameter calculation processing of step S12 performed after 

corresponding-points extract processing of said step S11 is explained. 

[0040] When an image is made into two sheets, (also in composition of two or more sheets, 

your considering two sheets first of all, since it is the repeat of composition of two sheets), 

and its gap can be expressed with the difference of advancing side by side of x and the 

direction of y, rotation, and a dilation ratio. Therefore, a point (x y), and corresponding 

(corresponding x\ y') can be expressed as follows. 

[0041] 

[Equation 1] 

Here, in theta, an angle of rotation, and deltax and delta y show advancing side by side, and m 
shows a scale factor. Therefore, this coordinate transformation can be expressed by asking for 
Parameters A, B, C, and D. In previous corresponding-points extract processing, corresponding 
points (x y) and two or more groups of (x 1 , yO were acquired. This is asked for Parameters A, B, 
C, and D using a least square method. 
[0042] 

[Equation 2] 

It is ****** and is [0043]. 
[Equation 3] 

It asks for the ******** parameters A, B, C, and D. It is here and is [0044]. 
[Equation 4] 

If it carries out, Parameters A, B, C, and D can be expressed as follows. 
[0045] 

[Equation 5] 

Parameters A, B, C, and D are computed by calculating p8 from this parameter pi, and 
substituting for an upper type. 

[0046] Next, image composition processing of step S13 is explained. Since it asked, Parameters 
A, B, C, and D are degree types [0047]. 
[Equation 6] 
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A synthetic image can be obtained, if it is alike and substitutes. This image composition 
processing is illustrated to drawing 8 . When images are the left and the right images 51 and 52, 
the image 51 twice the magnitude of the left is secured as a synthetic image 53. The left image 
51 is copied here as it is first (5l0. Next, it asks for the corresponding field (x\ y') 55 from an 
upper type about the remaining fields (x y) 54 of a synthetic image. And the pixel of (x\ y f ) of 
the right image 52 is copied to (x, y) (52*). This is performed to all the remaining fields of a 
synthetic image. 

[0048] Drawing 9 is a flow chart which shows image composition processing. 
[0049] At step S41, a twice as many field as the 1st image (left image in drawing 8 ) is secured 
as a synthetic image field. At step S42, the 1st image is simply copied to this synthetic image 
field. At step S43, it asks for a corresponding field (x\ yO from an upper type about the 
remaining fields (x y) of a synthetic image. In step S44, if (x\ yO confirm whether it is movable 
in it being in the 2nd image (right image in drawing 8 ) and there are about it, they will copy 
the pixel of (x\ y') to (x, y) at step S45. 

[0050] Synthetic processing ends the above repeatedly to all the remaining fields of a synthetic 
image. A panorama image can be obtained by this. 

[0051] Next, image extract processing of step S5 in which it **4**(ed) is explained. This image 
extract processing is performed in the image extract means 28. In this system, two or more 
extract approaches are shown to a user, and an extract image is determined by choosing the 
approach of arbitration from the inside. Drawing 10 (a) - (d) is drawing showing how to extract 
a rectangle field from the panorama image which compounded the image of two sheets and was 
able to do it. 

[0052] In order to create a panorama image, when the image of two sheets is photoed with an 
electronic camera etc., in not using a tripod etc., it is easy to produce a gap and an inclination 
between images. Drawing 10 (a) The images 61 and 62 of two sheets include-angle theta Incline, 
it shifts and the panorama image shown in - (d) is compounded, as shown in this drawing. With 
the image extract means 28 of this operation gestalt, some extract approaches are established, 
and a rectangle is extracted or it makes it possible automatically to take and extract the middle 
of an inclination according to each image which becomes the origin of a panorama image. 
[0053] First, in this example, a rectangle 63 is extracted on the basis of the image which is level 
as for the extract approach 1 shown in this drawing (a). In this example, a rectangle 64 is 
extracted on the basis of another image with which the extract approach 2 shown in this 
drawing (b) was leaned for composition. The extract approach 3 shown in this drawing (c) 
extracts the rectangle to which only the one half of the inclination between the images of two 
sheets inclined, and the rectangle 65 which inclined theta/2 is extracted in this example. In 
addition, the extract images 64 and 65 of the extract approach 2 and the extract approach 3 
serve as -theta and image data which only -theta/2 rotates and does not have an inclination, 
respectively. Both the extract approaches 4 shown in this drawing (d) extract the rectangle 
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containing the image of two sheets, and a rectangle 66 hits this in this example. 
[0054] By the way, various patterns can be considered to how with which the image of two 
sheets laps. Moreover, although the extract approach of a rectangle field can consider various 
things within a panorama image, in this system, the extract approach of a rectangle field is 
beforehand decided about all the ways of lapping. Drawing 11 is drawing showing an example 
of the rectangle which the image of two sheets laps and is extracted the direction, this 
expresses the case where it is based on the extract approach 1, and the half-tone-dot-meshing 
part in each panorama image 71 serves as the extract field 72. In this system, these data are 
held as an extract pattern table. A part of the extract pattern table is shown in drawing 12 . 
[0055] The line 81 of drawing 12 is equivalent to the case of the panorama image shown in 
drawing 11 . This is explained using drawing 13 . 

[0056] Drawing 13 is the explanatory view of an extract pattern table, and expresses the 
rectangular location with the upper left coordinate and upper left angle of rotation theta of 
each rectangle. Conditions 91 are searched for as conditions for how depending on which two 
rectangles lap from drawing 13 to become like the panorama image 71. Moreover, the 
coordinate of each top -most vertices of the extract field 72 is searched for like 92. These data 
are stored in the extract pattern table 80, respectively. Furthermore, since it is necessary to 
rotate an extract image when each side of the field after an extract is not level to a x axis or the 
y-axis, the item which describes the include angle at that time has also been included. 
[0057] Thus, the calculated value is stored for every lap direction of all. Moreover, an extract 
pattern table exists for every extract approach. 

[0058] Next, the processing which extracts an image using the extract pattern table mentioned 
above is explained using the flow chart of drawing 14 . 

[0059] First, in step S51, it investigates whether the panorama image to process is equivalent 
to which pattern by investigating the item of the "conditions" in the table corresponding to the 
extract approach among the extract pattern tables mentioned above. Next, in step S52, the 
data of an extract field which correspond from a table are taken out, and the image data of a 
part according to it is extracted from a panorama image. At subsequent step S53, the item of 
"rotation" of a table is investigated and extract image data is rotated if needed. 
[0060] As mentioned above, the extract image data at the time of using various ways of lapping 
and the various extract approaches is obtained. 

[0061] Next, the actuation screen for choosing the rectangle extracted from a panorama image 
is shown in drawing 15 . 

[0062] 100 of drawing 15 is a screen displayed when Drag&Drop [ a user catalog 34 / catalog / 
31 / camera / panorama image data ] in drawing 3 . In drawing 15 , 101 is a panorama image 
display field where the image 102 by which panorama composition was carried out is displayed. 
The abstract image samples 103-106 express the result at the time of extracting a rectangle 
field by the various extract approaches mentioned above from the panorama image 102 as the 
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contraction image, and are equivalent to the extract approach 4 from the extract approach 1, 
respectively. 

[0063] If a user clicks the thing of arbitration with a mouse 3 from the extract image sample 
currently displayed, the rectangle field corresponding to the extract approach will be displayed 
like the extract rectangle 107 on the panorama image 102. Moreover, it is surrounded and 
expressed as a frame like the extract image sample 108 chosen. The rectangle field which 
repeats an extract image sample, and is specified and extracted can be checked in the 
panorama image display field 101 until the desired extract approach is found. When the 
desired extract approach is found, the image of the approach specified is registered into a 
system by specifying the O.K. carbon button 109. In addition, the step which chooses the 
explained extract image can also be skipped by specifying the extract approach as the system 
beforehand here. 

[0064] Although the number of the images for creating a panorama image is two in the above 
explanation and the case where they are connected with a longitudinal direction and 
compounded has been described, it can be adapted also for the panorama image which leads to 
the panorama image which consists of an image of two or more sheets, or all approaches, 
without restricting to it. Moreover, not only the approach that showed the approach of 
extracting the image which serves as a rectangle from a panorama image to the 
above-mentioned operation gestalt but various things can be adapted. 
[0065] 

[Effect of the Invention] Since it had a rectangle field extract means extract automatically the 
image data contained to the field which serves as a rectangle from the inside of the image after 
composition of two or more images, and a panorama image creation means created said 
panorama image based on the extract result of said rectangle field extract means according to 
the panorama image composition system of claim 1 as explained in full detail above, it becomes 
possible to obtain a good image without a dummy area. 

[0066] Since the field used as said rectangle was beforehand decided with the configuration of 
the image after composition of two or more of said images in the panorama image composition 
system of above-mentioned claim 1 according to the panorama image composition system of 
claim 2, it becomes possible to obtain a good image without a dummy area simply and exactly. 
[0067] Since said rectangle field extract means was considered as the configuration which 
extracts said image data with two or more rectangle patterns, chose the thing of arbitration 
from the inside and used the selection result as said panorama image, it can choose the extract 
approach according to the contents of the image, and, according to the panorama image 
composition system of claim 3, becomes possible [ obtaining a good image without a dummy 
area simply and exactly ] in the panorama image composition system of above-mentioned claim 
1. 

[0068] In the panorama image composition approach which according to the panorama image 
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composition approach of claim 4 compounds two or more images which the part overlaps as a 
field, and creates the panorama image of one sheet Since rectangle field extract processing in 
which the image data contained to the field which serves as a rectangle from the inside of the 
image after composition of two or more of said images is extracted automatically is performed 
and said panorama image was created based on the extract result of the rectangle field extract 
processing It becomes possible to obtain a good image without a dummy area. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the panorama image composition structure of a 
system concerning one gestalt of operation of this invention. 

[Drawing 2] It is the external view showing the configuration of the personal computer system 
which is the platform where the panorama image composition system of this invention is 
carried out. 

[Drawing 3] It is drawing showing the actuation which copies the image data in a camera into 
a computer. 

[Drawing 4] It is the flow chart which shows the processing performed in case the image data 
in a camera is copied into a computer. 

[Drawing 5] It is the flow chart of panorama composition processing. 

[Drawing 6] It is the flow chart of the algorithm of corresponding-points extract processing. 
[Drawing 7] It is drawing showing the template image and matching range of 
corresponding-points extract processing. 

[Drawing 8] It is drawing showing image composition processing. 

[Drawing 9] It is the flow chart which shows image composition processing. 

[Drawing 10] It is drawing showing how to extract a rectangle field from a panorama image. 

[Drawing 1 1] It is drawing showing an example of the rectangle which the image of two sheets 

laps and is extracted the direction. 

[Drawing 12] It is drawing showing an example of an extract pattern table. 
[Drawing 13] It is the explanatory view of an extract pattern table. 
[Drawing 14] It is drawing showing image extract processing. 

[Drawing 1 5] It is drawing showing the actuation which chooses the rectangle field extracted 
from a panorama image. 

[Drawing 16] It is drawing showing an example of the conventional panorama image 
composition. 

[Description of Notations] 
1 Computer System Body 



11/12 



[JP,09-091407,A] 

2 Display 

3 Mouse 

4 Mouse Button 

5 Keyboard 

6 General Interface 

7 Electronic Camera 

11 Hardware 

12 OS 

13 Application Software 

14 Hard Disk 

15 File System 

16 Disk 10 Interface 

17 Drawing Managerial System 

18 Video Interface 

19 Input Device Managerial System 

20 Keyboard Interface 

21 Mouse Interface 

22 Bidirectional Interface / SCSI Interface 

23 Image Data Management System 

24 Data Control Means 

25 Data Display Means 

26 Panorama Image Creation System 

27 Panorama Composition Means 

28 Image Extract Means 



[Translation done.] 
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